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ABSTRACT 



This paper identifies existing and potential measures of 
teacher qualifications as a single aspect of teacher quality, emphasizing 
their underlying rationale, ways to use them, and availability and quality of 
data collected from various sources. It categorizes types of teacher 
qualification measures, discusses data sources, and notes availability and 
quality of data collected from these sources. The paper groups measures of 
teacher qualifications into four categories: ability or aptitude, content 
knowledge, pedagogic knowledge, and teaching credentials. The two principal 
data sources are self-reports on questionnaires like the Schools and Staffing 
Survey (SASS) and teachers' academic and test-score records maintained by 
colleges/universities, the Educational Testing Service, and the American 
College Testing Company. The review suggests that most data collected on 
teacher qualifications are general information with response rates similar to 
other non-sensitive items. Collecting highly specific, sensitive, or 
difficult to recall information has been done less often, with response rates 
substantially lower than average. The SASS and the Baccalaureate and Beyond 
study collect the most information on the broadest range of teacher 
qualification measures. Teachers' academic records provide the most complete 
picture of teacher qualifications, but access to these records has legal and 
financial considerations. An appendix presents tables showing teacher 
qualification measures, data collection surveys, and sources. (Contains 15 
references.) (SM) 
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Introduction 



Since the 1980s, policymakers, educators, and analysts have discussed the relationship 
between the quality of teachers in the nation’s classrooms and the condition of education. With 
the right data, policymakers and others interested in education reform would be better equipped 
to address such issues as: the quality of prospective and current teachers; differences, if any, 
between college graduates who become teachers and those who choose other professions; and 
changes in teacher quality over time. Analysis of such data might also provide insight into the 
relationship between teacher quality and student achievement and the differential characteristics 
of various measures of teacher qualifications, such as ability, content knowledge, pedagogic 
knowledge, and teaching credentials. 

For this paper, we distinguish among the terms teaching quality, teacher quality, and 
teaching qualifications, and address only the last of these. Conceptually, measuring teaching 
quality ought to be a high priority of any examination of teaching and learning, since, literally 
defined, it represents the direct effect on students by teachers as they create their classroom 
magic. Teacher quality, representing some measure of the dynamic characteristics, abilities, and 
decisions of teachers is, like teaching quality, a complex and subjectively defined concept. 
Teaching qualifications, static measures grounded on relatively objective assessments of the 
skills, abilities, and knowledge that others have determined to be important, may also be subject 
to much debate, but at least have been administratively defined and addressed at the state level. 

This paper focuses exclusively on teacher qualifications. Measuring teacher 
qualifications is conceptually and practically more approachable than defining and measuring 
teacher quality or teaching quality, despite the measurement limitations and data challenges 
identified in this paper. Measuring teacher quality and teaching quality would each likely 
require substantially more research, review, thought, and discussions with national experts as 
preliminary steps toward developing a consensus definition, measurement objective, and data 
collection program. Of the three objectives, better national measurement of teacher 
qualifications may be the most reachable. 

In this review, we identify existing and potential measures of teacher qualifications as a 
single aspect of teacher quality. We categorize the types of teacher qualification measures, 
discuss the sources of data, and the availability and quality of data collected from these sources. 
Teacher qualification measures, data collection surveys, and sources discussed in this paper are 
shown in Table 1 of the Appendix. 
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This focus on teacher qualifications does not at all imply that qualifications are better 
indicators of quality than, for example, knowing the level of cognitive demand associated with a 
teacher’s emphasis on selected curriculum topics, or understanding the unique mix of 
instructional practices a teacher orchestrates as she or he moves through the curriculum. Those 
are indeed important topics and deserve concerted effort to define, measure, and track, but would 
require substantially more attention than can be provided by this brief review of existing and 
potential measures. 



Teacher Qualification Measures 

For this paper, we have grouped measures of teacher qualifications into foiu* categories: 
(1) ability or aptitude, (2) content knowledge, (3) pedagogic knowledge, and (4) teaching 
credentials. For each category, we discuss the underlying rationale and current and potential 
measures. 



Ability or Aptitude 

The strength of one’s verbal, mathematical and analytic skills is considered to be a strong 
sign of an individual’s ability or aptitude. Scores on national assessments of these areas are part 
of the information used by many institutions of higher education to determine a candidate’s 
suitability for admission. Consequently, regardless of their academic plans or intended 
occupations, the majority of college-bound students across the country take the SAT and/or ACT 
when applying for undergraduate study and the GRE when applying for graduate study. Scores 
from the National Teacher Exam (NTE) and Praxis I of the Praxis Series: Professional 
Assessments for Beginning Teachers are other measures of the ability and reading, math, and 
writing skills of prospective and beginning teachers. Students seeking entry into certain teaching 
programs and those applying for teacher licensure in some states are required to take the NTE or 
Praxis I. The NTE is used for entry into some teacher preparation programs and for state 
licensing. Praxis I is the first component of ETS’s new series of program and licensing exams 
intended to ultimately replace the NTE. 

With data from these large-scale, nationally-taken, standardized tests, analysts can gauge 
the caliber of prospective and current teachers. Since these tests have been given for a number of 
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years (more than 50 years in the case of the SAT), analysts can identify national trends or 
significant shifts in the ability of cohorts of test takers over time, develop an informal measure of 
the selectivity of colleges and universities using average SAT scores of admitted students, and 
assess the quality and analyze changes over time of the teacher supply pool and current teaching 
force using the NTE and Praxis I scores. 

In an essay on the undergraduate experiences of teachers, analysts compared the college 
entrance exam score data of 1992-93 Baccalaureate and Beyond (B&B:92-93) sample members 
and found that teachers tended to perform below non-teachers on these achievement tests 
(Henke, Geis, and Giambattista, 1996). As noted in the essay, “At several points along the 
teacher pipeline, those more inclined toward teaching tended to have lower college entrance 
examination scores ... than those less inclined toward teaching” (p.l5). 

While national exams do permit national cross-sectioijal and longitudinal comparisons, 
there are potential limitations to relying solely on these tests as measures of teacher 
qualifications. As Berliner and Biddle (1995) note, for example, the SAT is a “one shot, 
multiple-choice test that is taken by high school seniors (and) assesses only students’ knowledge 
of a fixed set of topics in mathematics and English. . .” (p. 22). Ingersoll (1996) recognizes the 
near-universal availability and face validity of SAT scores, but strongly questions their use to 
measure ability. Recent changes in the format of the SAT may also be problematic for analysts 
interested in mapping trends in teacher qualifications over time. Since ACT content topics are 
revised each year to reflect changes in the curricula at colleges and universities, making 
longitudinal comparisons based on ACT scores may also be problematic (Berliner and Biddle, 
1995). Analysis of NTE or Praxis data is also limited since analysts do not have access to 
individual-level information on NTE or Praxis scores. 

Content Knowled£e 

While standardized measures of ability may be a basic starting point for assessing teacher 
qualifications, they provide little information about teacher knowledge of particular content 
areas. Teachers with academic backgrounds in the subject of their main teaching assignments 
are presumed to be better prepared than those teaching outside their field of academic study. 
Analysts can assess the level of teachers’ content knowledge using data on the type and number 
of courses taken, majors and minors, credits earned in specific subject areas, and achievement in 
specific subject areas. Current measures of subject knowledge include: Praxis II: Subject 
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Assessments test scores; GPA in major; area of certification; GRE subject test score; number and 
type of courses taken; credits earned; and undergraduate/graduate major and/or minor. Content 
knowledge and measures of it are time-sensitive in that some content knowledge has a limited 
lifespan. This suggests that measuring content knowledge may be more relevant for beginning 
teachers than for experienced teachers. 

Data on these measures help estimate the effect on student achievement resulting from 
assigning teachers to subjects outside of their certification or major field of study. While Praxis 
II and GRE subject scores are standardized and therefore easily compared, GPA and course 
information are limited in that both are relative to the granting institution’s policies and 
procedures, as well as variations in the academic rigor or level of difficulty of the courses taken 
by students. 



Pedagogic Knowled£e 

Ability, content knowledge, and certification communicate little about teachers’ 
understanding of content-specific pedagogy or their ability to successfully share their content 
knowledge with students. SAT scores and the number of courses taken are not clear indicators 
of how well teachers communicate with, motivate, challenge, or engage students — all traits one 
might consider when measuring teacher qualifications. While it is clearly desirable to collect 
data on pedagogic knowledge and ability, this measure is more difficult to quantify and may be 
more subjective than ability or content knowledge. Some tests and standards for quantifying 
pedagogic knowledge have been developed; more are in the process. They include National 
Board for Professional Teaching Standards (NBPTS) certification; Praxis HI: Classroom 
Performance Assessments, which is being pilot tested in Ohio (ETS, 1998); and the Interstate 
New Teacher Assessment and Support Consortium (INTASC) Test for Teaching Knowledge, 
which is being developed. 

Praxis III: Classroom Performance Assessments are performed by trained assessors using 
a combination of in-class observations of teaching performance, written documentation, and pre- 
and post-observation interviews. Using a common evaluation framework, ETS expects Praxis III 
results to contribute to state licensing decisions (ETS, 1998). 

The National Board for Professional Teaching Standards is currently setting advanced 
standards in more than 30 certificate fields and developing multi-part assessments that will be 
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used to measure the professional skills, knowledge, and accomplishments of teachers applying 
for National Board certification. To date, standards have been developed in 21 fields (NBPTS 
Web Site, 8/4/98). 

EMTASC is currently developing the ENTASC Test for Teaching Knowledge. With this 
test, they intend to measure beginning teachers’ understanding of foundational knowledge and 
the skills essential to the teaching profession, such as child development, theories of teaching and 
learning, diagnostic skills, and the role of student background in the learning process (Council of 
Chief State School Officers Web Site, 8/4/98). 



Teaching Credentials 

Data on teaching credentials include; degree(s) earned, name of the degree-granting 
institution, overall GPA, state teacher certification, and years of teaching experience. NCATE 
accreditation of the degree-granting institution is another potential measure of teacher quality. 
Such data may enable analysts to test the hypothesis that higher quality teachers have 
certification, high overall GPAs, advanced degrees from accredited teacher-training programs, 
and more teaching experience. 

Variations in standards and procedures used by universities in the grading process and by 
states in the teacher certification process (National Research Council, 1992), however, may limit 
analysts’ ability to generalize and compare teacher quality using state certification or GPA. ETS 
notes that state “qualifying scores [on Praxis] vary considerably across [the different subject] 
tests, depending on each test’s level of difficulty, and across states” (ETS, 1998, p.4). 
Furthermore, only 31 states plus the District of Columbia and the Virgin Islands use one or more 
Praxis exams for state teacher licensure (ETS, 1998). Comparisons based on GPAs must also be 
viewed with caution. While data from B&B:92-93 illustrate that teachers tend to have higher 
GPAs than non-teachers, Henke et al. (1996) suggest that this discrepancy is partly explained by 
differences in course-taking between these two groups, noting that: 

...those who taught, only prepared to teach, or were only considering teaching were more likely than other 
graduates to have taken education courses, less likely to have taken advanced mathematics and calculus, and 
tended to take fewer courses in science or engineering. Because grades in education course tend to be higher 
than those in advanced mathematics, calculus, science, and engineering courses, the mix of courses taken 
by those inclined to teach tended to result in higher GPAs than the mix taken by those who were not so 
inclined. 

(Henke et al., 1996, p. 15) 
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Data Sources: Availability and Quality 

The two principal sources for teacher qualification data are: (1) self-reports on 
questionnaires like the Schools and Staffing Survey (SASS) and (2) teachers’ academic and test- 
score records maintained by colleges/universities, the Education Testing Service (ETS), and the 
American College Testing (ACT) Company. In this section, we assess the availability and 
quality of data collected from these sources. 



Self-report Questionnaires 

Survey questionnaires provide the most common and cost-effective way of collecting 
nationally representative data on teachers and their qualifications. The following NCES data 
collections have gathered teacher qualification data from the self-reports of individuals who are 
considering teaching, studying to be teachers, currently teaching, or have previously taught: 
SASS, B&B, High School and Beyond (HS&B), Recent College Graduates (RCG), National 
Assessment of Educational Progress (NAEP), National Longitudinal Survey of 1972 (NLS:72), 
National Education Longitudinal Study of 1988 (NELS:88), National Postsecondary Student Aid 
Study (NPSAS), and Beginning Postsecondary Students (BPS). In Table 1 of the Appendix, we 
present the topics covered by each survey. 

Availability. Response patterns from the Chaney (1994) sub-sample of the 1990-91 
SASS indicate, not surprisingly, that very specific and/or sensitive items generate fewer 
responses than non-sensitive questions. For example, the response rates ranged between 97 and 
100 percent for general questions on degrees earned, while response rates for more specific 
questions on courses taken in teachers’ second teaching assignment were between 38 and 59 
percent. Response rates also tended to be lower for questions concerning the number of courses 
or credits taken than for items on whether or not courses had ever been taken. For example, 88 
percent of teachers responded to a general question on whether they had taken courses in 
computer science, but only 73 percent responded to a more specific question of the number of 
undergraduate computer science courses taken. Similarly, the percentage of responses on 
courses in teaching methods or education (98 percent) was higher than the percentage of 
responses on the specific number of teaching methods or education graduate courses (78 percent) 
(Chaney, 1994). 
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Similarly, B&B;93/94 respondents were less likely to respond to questions about their 
individual academic achievement. Nearly 30 percent of respondents reported that they did not 
know their SAT score and 0.4 percent refused to answer; more than 25 percent said they did not 
know their ACT scores and 0.3 percent refused to answer; and 58 percent said they did not know 
their advanced GRE score (Green, Meyers, Giese, Law, Speizer, Tardino, & Knepper, 1996). 
“Don’t know” responses were also high for questions on state teaching exam scores (33 percent) 
and undergraduate GPA (14 percent). Considering such low response rates, Henke et al. (1996) 
suggest using college transcripts as an alternative data collection method. 

Quality. The level of detail, sensitivity of an issue, and the respondent’s ability to 
accurately recall affect the quality of data gathered from teacher self-reports. Chaney (1994) 
examined the accuracy of teacher self-reports of college attendance on a small sample of SASS 
teacher questionnaires by comparing self reports to school transcripts. He discovered errors in 
both directions: some teachers reported school attendance not verified by the school and others 
failed to note attendance that was later indicated by the school. That study requested 1,835 
transcripts for 592 teachers and received 1,356 transcripts (74 percent). For 134 (9.9 percent) of 
all the transcripts requested, schools were unable to locate the transcript or said that the 
individual had never attended that school. (Of those 134 requests, Chaney's team determined 
that 121 were teacher misreports and 13 were college errors.) Additionally, the team received 
168 transcripts □...reflecting an undergraduate or graduate enrollment that had not been 
indicated on the SASS questionnaires. □ This represented 9 percent of all known transcripts for 
that sample (Chaney, 1994). 

Chaney also examined the accuracy of teacher self-reports on degree attainment and 
preparation. They could not confirm (a) 22 of the 528 reported bachelor's degrees (4.2 percent) 
or (b) 57 of the 195 reported master's degrees (29.2 percent). They also discovered nine master's 
degrees unreported by the 339 individuals (1.8 percent) reporting no such degree. A more 
complete description of Chaney’s study is included in Table 2 of the Appendix. 



Student Records 



Past NCES-sponsored data collections have obtained transcripts, other student record 
data, and standardized test scores of individuals who are considering teaching, studying to be 
teachers, currently teaching, or who have previously taught. The following NCES surveys 
include student record data: SASS:90/91 Teacher Transcript Study, B&B, HS&B, RCG, 
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NLS:72, BPS, and NPSAS. These data collection efforts obtained student record information 
from colleges/universities, and in some cases, ETS, and ACT, Inc. 

Availability. Legal issues involving individual privacy, financial costs, and time 
constraints each affect NCES’ access to data on teacher qualification measures. The Family 
Educational Rights and Privacy Act is the legal statute that protects the privacy of student 
education records. There are some cases in which signed consent is waived, but this is not the 
norm. The sections of the law that directly relate to NCES’ (or its authorized representative) 
authority to collect these data are included in Table 3 of the Appendix. 

In addition to FERPA, data collectors must consider the policies and longevity of data 
maintained by ETS and ACT. ETS maintains records of SAT scores dating back to 1941, but 
expunges GRE records five years after the exam is taken. ACT records are available from 1968 
forward. To access SAT, ACT, or GRE data requires the test taker’s permission, date of birth, 
and Social Security Number. Knowing the approximate time frame in which a student took the 
test also facilitates the collection of these records. 

Collecting student record abstracts or matches has additional costs. The price of 
college/university transcripts ranges from $5 to $12 (Dennis Carroll, NCES, personal 
communication, 9/15/98). Additional expenses to collect transcript data include technical 
assistance to schools and computer software to facilitate uniform record abstraction. ETS and 
ACT also charge for the release of student test data. Drew Malizio, NPSAS Project Officer, 
estimates that record matches done with ETS and ACT for NPSAS:95/96 and B&B:92-93 cost 
$25,000 to $35,000 (personal communication, September 17, 1998). 

Following are three examples of recent NCES data collection efforts that included student 
record abstracts or ETS and ACT matches: 

■ B&B:93/94 requested transcripts for all respondents who received bachelor’s degrees from 
schools that had participated in the National Postsecondary Student Aid Study (NPSAS) 
(Green et al., 1996). In six months, transcripts were collected for 98 percent of the eligible 
sample (Green et al., 1996). 

■ NPSAS data collectors performed post-interview matches with ETS and ACT of SAT and 
ACT scores for the NPSAS:95/96 sample of beginning students enrolled in four-year 
institutions. The record match took four to six weeks to complete (Drew Malizio, personal 
communication, September 18, 1998). As a result of the NPSAS:95/96 student record 
abstract and the ETS and ACT matches, NPSAS:95/96 obtained either an SAT or ACT score 
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for 85 percent of the students in the sub-sample (Paula Knepper (NCES) and Dan Kasprzyk 
(NCES), e-mail communication, July 7, 1998). 

• In the 1990-91 SASS Teacher Transcript Study, 592 eligible teachers (71 percent) agreed to 
participate. Three hundred and forty-nine teachers (59 percent of teachers who agreed to 
participate; 42 percent of the eligible sample) provided signed consent. The other 143 
teachers gave verbal consent during their telephone interview or supplied sufficient 
information for the release of their student record data. 

Tables 2, 4a, 4b, and 5 of the Appendix provide more detailed information on the 
collection procedures and success of these student record abstracts. 

Quality. While student records are likely to be the most reliable source for data on 
teacher qualification data, analysts must not assume that these data are error-free. For example, 
transcripts may not provide a complete picture of teachers’ course-taking histories. Transcripts 
from the degree-granting institution may exclude courses teachers completed at other universities 
during their undergraduate studies. Data taken from student records are not easily standardized 
or representative either. Schools may vary in the way failures, withdrawals, remedial/not-for- 
credit courses, and incompletes are treated (Chaney, 1994). Relying on transcripts to obtain data 
on GPAs also has certain drawbacks. GPAs are relative to courses taken and schools attended 
and make it difficult to compare individuals with different academic backgrounds (Henke et al., 
1996). Course-catalogs and descriptions of the school’s grading systems are needed in concert 
with transcripts for analysts to even begin to interpret GPA. 



Summary 

This review examined existing and potential measures of teacher qualifications, focusing 
on their underlying rationale, the ways such data may be used, and the availability and quality of 
data collected from various data sources. Ability or aptitude is often measured by SAT, ACT, 
GRE, NTE, and Praxis I scores; the tests are standardized and widely taken across the country; 
and their results can be easily generalized and compared. Data on all of the measures except for 
NTE and Praxis I scores can be collected from self-reports, transcripts, and national test records. 
Low response rates and false reporting on self-reports reduce the availability and reliability of 
self-reported data on ability measures; accessing such data from national testing organizations 
can be complex or impossible. Transcripts may be the best source for collecting these data. 
Analysts question the relationship between scores on these national tests and ability. 
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Content knowledge has been measured by Praxis II scores, GPA in major, area of 
teaching certification, GRE subject test scores, number and type of courses taken, credits earned, 
and undergraduate/graduate majors and/or minors. Transcripts are a direct and reliable method 
of collecting information on GPA in major and the exact number of courses taken in a field. 
Transcripts and/or ETS records provide the most reliable information on GRE subject test scores. 
Because of variations in grading systems and course content among postsecondary institutions, 
however, GPA and course-taking data are not easily generalized or comparable across 
individuals from different academic backgrounds. Self-reports are the most efficient and cost- 
effective way to collect complete and reliable data on the remaining content knowledge 
measures, especially Praxis II scores. Content knowledge may be most relevant for beginning or 
new teachers. 

NBPTS certification. Praxis III scores, and INTASC scores provide a measure of 
pedagogic knowledge and/or teaching ability. These measures have yet to be used widely and 
have not been collected on a national level. 

Teaching credential measures include overall GPA, highest degree earned, name of 
degree-granting institution, NCATE accreditation of that institution, and teaching experience. 
With the exception of GPAs, which are more accurately provided by transcripts, self-reports may 
be a complete and reliable source for data on this type of basic background information. 

This review suggests that; 

• Most data collected On teacher qualifications have been general information (i.e., degrees 
earned or major) with response rates similar to other non-sensitive items. 

• Collecting information that is highly specific, sensitive, or difficult to recall (i.e., GPA or 
SAT/ACT score) has been done less often and with response rates substantially lower 
than average. 

• The Schools and Staffing Survey and the Baccalaureate and Beyond study currently 
collect the most information on the broadest range of teacher qualification measures. 

• The Baccalaureate and Beyond study and the survey of Recent College Graduates are the 
only NCES data collections that collect information on teachers’ tested ability or 
academic achievement. 

• Teachers’ academic records provide a detailed and complete picture of teacher 
qualifications, but access to these records has legal and financial considerations. 



Future Directions 



Building on the information and understanding developed from the previous efforts 
reported above, and in concert with the SASS staff, we make the following recommendations. 
Each relies on a different data source that could lead to improved national measures of teacher 
qualifications. 



■ Investigate the feasibility of a transcript study as part of the Teacher Followup Survey, 
given that the SASS timetable is too advanced to add non-fieldtested items. Determine 
the cost of college transcript studies and whether the FERPA requirement for signed 
consent could be waived. Will the added value of transcript data — i.e., the completeness 
of information, level of detail, and the accuracy of data on measures like coursetaking 
and GPA — outweigh the legal and financial burdens to collect it? Transcript studies 
would provide information on teacher aptitude and knowledge of content areas and 
pedagogic techniques; repeated data collections could address change over time in the 
qualifications of die teaching force. 

■ Examine teacher response to providing signed consent. Social Security numbers, and 
other personal identifying information required by ETS and ACT for the release of SAT, 
ACT, GRE, and Praxis scores. SAT, ACT, GRE, and Praxis I scores could provide 
information on teacher ability and aptitude; Praxis II and some GRE scores would 
provide a measure of content knowledge. This could be done by using a sub-sample of 
the SASS teacher sample. 

■ Determine the type and availability of data collected by states for teacher certification. 
What data do states routinely collect, how long do they mainatin these data, and what is 
the quality? What are the idios 5 mcrasies of state record collection practices that may 
facilitate or impede cross-state comparisons? Then explore the possibility of obtaining 
qualification data on teachers from state records. Will states and/or teachers consent to 
the release of this information? State records could be expected to include data that 
measure aptitude, pedagogic knowledge, content knowledge, and teaching credentials. 

Each exploration should consider: (1) the recency of information and its effect on quality, 
(2) the degree to which measurements might be expected to change over time and so influence 
data collection frequency, (3) the level at which the data are best collected, (4) the method by 
which data are best collected, and (5) whether and how such information on teacher 
qualifications would inform our understanding of the quality of college graduates choosing to be 
teachers (relative to others) and the changes in teacher quality over time. 
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Teachers are the primary deliverers of K-12 education. Having commonly accepted 
national measures of teacher qualifications will help policymakers and the public determine and 
appreciate the quality of the teacher force and, if necessary, identify steps to maintain that 
quality. 
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Table 1: Coverage of Teacher Qualiflcation Measures in NCES Data Collections 

(S=self-report, I=institutional record and/or transcript, E=ETS/ACT record) 
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Table 2: 1990-91 SASS Teacher Transcript Study 



Overview 



This study is a methodological study designed to determine the best method for obtaining information on teachers* 
backgrounds. Specifically, two alternative research methodologies are compared: the collection of teachers* self- 
reports of their academic qualifications, as provided by teacher self-reported responses to SASS:90/91 survey 
questionnaires, and the use of teachers* college transcripts. 

Sample Size and Response Rates 

■ 200 schools were asked to participate in the 1990-91 SASS Teacher Transcript Study. 

■ 174 schools were ultimately determined to be eligible for the study and agreed to participate.^ 

■ From these 174 schools, 835 teachers were determined to be eligible sample members. 

■ 637 teachers (76 percent) responded. 

■ 45 teachers either refused participation in the transcript portion of the study, or failed to supply any 
information on which colleges they attended. These teachers were left out of the transcript portion of the 
study, leaving a total of 592 teachers (71 percent of the eligible sample). 

■ 1,835 transcript requests were made for the 592 teachers. 

■ 349 teachers (59 percent of teachers who agreed to participate; 42 percent of the eligible sample) gave 
signed permission to collect the transcripts. The other 143 teachers either verbally consented or provided 
enough information so that their transcripts could be collected. 

■ The school response rate for the 1,835 original transcript requests was 81.2%, with 1,356 transcripts sent and 
1 34 cases in which a school reported that no transcript was available for the student. 

■ The study obtained all transcripts for 5 1 percent of teachers who gave their signed permission. It obtained 
all transcripts for 37 percent of the teachers who did not provide signed consent. 

1 . It is unclear if 1 74 represents the total number of schools found to be eligible or the total number of eligible schools 
minus those that refused to participate. 



Source: The accuracy of teachers* self-reports on their postsecondary 
education: Teacher Transcript Study, Schools and Staffing Survey 
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Table 3: The Family Educational Rights and Privacy Act (FERPA) 



Subpart D— May an Educational Agency or Institution Disclose Personally Identifiable Information from Education 
Records? 

§99.31 Under what conditions is prior consent not required to disclose information? 

(а) An educational agency or institution may disclose personally identifiable information from an education record of a student 
without the consent required by §99.30 if the disclosure meets one or more of the following conditions: 

(3) The disclosure is, subject to the requirements of §99.35, to authorized representatives of: 

(i) The Comptroller General of the United States 

(ii) The Secretary; or 

(iii) State and local educational authorities 

(б) (i) The disclosure is to organization conducting studies for, or on behalf of, educational agencies or institutions to: 

(A) Develop, validate, or administer predictive tests; 

(B) Administer student aid programs; or 

(C) Improve instruction. 

(ii) The agency or institution may disclose information under paragraph (a)(6)(I) of this section only if: 

(A) The study is conducted in a manner that does not permit personal identification of parents and students by individuals other 
than representatives of the organization; and 

(B) The information is destroyed when no longer needed for the purposes for which the study was conducted. 

(iii) If this Office determines that a third party outside the educational agency or institution to whom information is disclosed 
under this paragraph (a)(6) violates paragraph (a)(6)(ii)(B) of this section, the educational agency or institution may not 
allow that third party access to personally identifiable information from education records for at least five years. 

(iv) For the purposes of paragraph (a)(6) of this section, the term “organization” includes, but is not limited to. Federal, State, 
and local agencies, and independent organizations. 

(Authority: 20 U.S.C. 1232g(b)(l )(D)) 

§9935 What conditions apply to disclosure of information for Federal or State program purposes? 

(a) The officials listed in §99.3 1 (a)(3) may have access to education records in connection with an audit or evaluation of 
Federal or State supported education programs, or for the enforcement of or compliance with Federal legal requirements 
which relate to those programs. 

(b) Information that is collected under paragraph (a) of this section must: 

(1) Be protected in a manner that does not permit personal identification of individuals by anyone except the officials referred 
to in paragraph (a) of this section; and 

(2) Be destroyed when no longer needed for the purposes listed in paragraph (a) of this section. 

(c) Pruagraph (b) of this section does not apply if: 

( 1 ) The parent or eligible student has given written consent for the disclosure under §99.30; or 

(2) The collection of personally identifiable information is specifically authorized by Federal law. 

(Authority: 20 U.S.C. ] 232(b)(3)) 
Source: Sharing Information: A Guide to the. Family Educational Rights 
and Privacy Act and Participation in Juvenile Justice Programs (1997) 
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Table 4a: 

B&B:93/94 Longitudinal Study 



Table 4b: 

B&B:93/94 Transcript Collection Procedures 



Overview 

The B&B:93-94 study is the first in a series of five-follow up 
interviews of persons who received a bachelor* s degree in 
the 1992-1993 academic year. Baseline data for the 
B&B:93 cohort were collected as part of the National 
Postsecondary Student A id Study ( NFS A S: 93). The first 
follow-up interview (B&B:93-94) collected information from 
respondents one year after they received their bachelor*s 
degree. Subsequent interviews will take place at three year 
intervals. By the end of the 12-year period, most students 
who attend graduate or professional schools should have 
completed, or nearly completed, their education and be 
established in their careers. 



Sample Size and Response Rates 

■ 12,478 students were initially identified as potential 
B&B sample members during the NPSAS:93 data 
collection. 

■ As part of the B&B:93-94 first follow-up, a transcript 
was requested for all of the 12,478 students initially 
identified as eligible for the B&B:93 sample. 

■ In all, 626 of the 635 (99 percent) of the eligible schools 
complied with the request for student transcripts, and 
another 80 schools (1,258 students) were considered 
out-of-scope, resulting in a transcript collection rate of 
98 percent at the student level (10,970/1 1,220). 

■ Of the initially identified 12,478 cases, 1520 were 
found to be ineligible or out of scope (primarily because 
their graduation date fell outside the July 1 - June 30 
window), leaving a total of 10,958 eligible-cases for the 
B&B:93-94 interview. 

■ Interviews were completed with 10,080 (92%) of these 
students. Of the 8% of students that did not participate, 
6% refused to take part, and another 1 percent did not 
participate for other reasons. Just under 1% of potential 
respondents could not be located. 

Source: The BScB 93-94 First 
Follow-up Methodology Report 



Packets containing the following were mailed to sample 
schools from which B&B sample members graduated. These 
packets included: 

■ a B&B information leaflet, 

■ letters from the NCES, NORC, and the 
American Association of Collegiate Registrars 
and Admission Officers; 

■ a list of professional organization endorsements; 

■ instructions for sending transcripts; 

■ a student checklist with the names and other 
relevant information for each student for whom a 
transcript was requested; 

■ a request for reimbursement form and postage 
paid return envelope in which to send student 
transcripts. 

Schools were also asked to provide a course catalog and 
information on their grading and credit-granting systems and 
school term. 



Source: The B&B 93-94 First 
Follow-up Methodology Report 
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Table 5: Accessing ETS and ACT Record Data 



Overview 

NPSAS data coUectors performed post-interview matches with ETS and ACT of SAT and ACT scores for 
NPSAS:95/96 sample beginning students enrolled in four-year institutions. They also performed a match with ETS 
for the GRE scores of the B&B:92-93 cohort. Below we describe the legal issues, financial costs, and timeframe of 
this collection, as well as the results of the match J 



Legal Issues 

■ Since data were requested for NPSAS sample members, neither ETS nor ACT required the permission of the 
test takers before releasing test score data. 

■ NCES did, however, assure ETS and ACT that student data would be handled confidentially and that individual 
scores would not be released. 

■ Analysts with access to these data were required to sign affidavits stating that they would protect the 
confidentiality of each student. 



Financial Issues 

■ While he did not have exact figures. Drew Malizio, the NCES staff person on this project, estimates that the 
combined cost of attaining the data from ETS and ACT for the NPSAS:95/96 and B&B:92-93 samples, was 
between $25,000 and $30,000. 



Timeframe 

■ Drew Malizio estimates that it took between four and six weeks to attain these data from ETS and ACT. 



Results 

■ As a result of the match and the student record abstract done in NPS AS:95/96, NPSAS now has either SAT or 
ACT scores for approximately 85 percent of the approximately 12,000 beginning students in 4-year institutions 
included in the NPSAS:95/96 sample. 

■ The results of the GRE match are not yet available. 



This information was provided by Paula Knepper (e-mail to Dan Kasprzyk, 7/7/98 and personal communication, 
9/17/98) and Drew Malizio (personal communication, 9/18/98). There is no written report outlining the process 
involved in performing these matches or the results found. 
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Listing of NCES Working Papers to Date 

Please contact Angela Miles at (202) 219-1761 (angela_miles@ed.gov) 
if you are interested in any of the following papers 



Number 


Title 


Contact 


94-01 (July) 


Schools and Staffing Survey (SASS) Papers Presented 
at Meetings of the American Statistical Association 


Dan Kasprzyk 


94-02 (July) 


Generalized Variance Estimate for Schools and 
Staffing Survey (SASS) 


Dan Kasprzyk 


94-03 (July) 


1991 Schools and Staffing Survey (SASS) Reinterview 
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Dan Kasprzyk 


94-04 (July) 


The Accuracy of Teachers’ Self-reports on their 
Postsecondary Education: Teacher Transcript Study, 
Schools and Staffing Survey 


Dan Kasprzyk 
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Cost-of-Education Differentials Across the States 


William Fowler 
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the 1994 Meeting of the American Statistical 
Association 


Dan Kasprzyk 
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QED Estimates of the 1990-91 Schools and Staffing 
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Estimates with CCD Estimates 


Dan Kasprzyk 


95-03 (Jan.) 


Schools and Staffing Survey: 1990-91 SASS Cross- 
Questionnaire Analysis 


Dan Kasprzyk 


95-04 (Jan.) 


National Education Longitudinal Study of 1988: 
Second Follow-up Questionnaire Content Areas and 
Research Issues 


Jeffrey Owings 


95-05 (Jan.) 


National Education Longitudinal Study of 1988: 
Conducting Trend Analyses of NLS-72, HS&B, and 
NELS:88 Seniors 


Jeffrey Owings 



O 



32 



Listing of NCES Working Papers to Date— Continued 



Number 


Title 


Contact 


95-06 (Jan.) 


National Education Longitudinal Study of 1988: 
Conducting Cross-Cohort Comparisons Using HS&B, 
NAEP, and NELS:88 Academic Transcript Data 


Jeffrey Owings 


95-07 (Jan.) 


National Education Longitudinal Study of 1988: 
Conducting Trend Analyses HS&B and NELS:88 
Sophomore Cohort Dropouts 


Jeffrey Owings 


95-08 (Feb.) 


CCD Adjustment to the 1990-91 SASS: A 
Comparison of Estimates 


Dan Kasprzyk 


95-09 (Feb.) 


The Results of the 1993 Teacher List Validation Study 
(TLVS) 


Dan Kasprzyk 


95-10 (Feb.) 


The Results of the 1991-92 Teacher Follow-up Survey 
(TFS) Reinterview and Extensive Reconciliation 


Dan Kasprzyk 


95-11 (Mar.) 


Measuring Instruction, Curriculum Content, and 
Instructional Resources; The Status of Recent Work 


Sharon Bobbitt & 
John Ralph 


95-12 (Mar.) 


Rural Education Data User’s Guide 


Samuel Peng 


95-13 (Mar.) 


Assessing Students with Disabilities and Limited 
English Proficiency 


James Houser 


95-14 (Mar.) 


Empirical Evaluation of Social, Psychological, & 
Educational Construct Variables Used in NCES 
Surveys 


Samuel Peng 


95-15 (Apr.) 


Classroom Instructional Processes: A Review of 
Existing Measurement Approaches and Their 
Applicability for the Teacher Follow-up Survey 


Sharon Bobbitt 


95-16 (Apr.) 


Intersurvey Consistency in NCES Private School 
Surveys 


Steven Kaufman 


95-17 (May) 


Estimates of Expenditures for Private K-12 Schools 


Stephen 

Broughman 


95-18 (Nov.) 


An Agenda for Research on Teachers and Schools: 
Revisiting NCES’ Schools and Staffing Survey 


Dan Kasprzyk 


96-01 (Jan.) 


Methodological Issues in the Study of Teachers’ 
Careers: Critical Features of a Truly Longitudinal 
Study 


Dan Kasprzyk 
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Listing of NCES Working Papers to Date— Continued 



Number 


Title 
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Dan Kasprzyk 


96-03 (Feb.) 
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Jeffrey Owings 


96-04 (Feb.) 


Census Mapping Project/School District Data Book 


Tai Phan 


96-05 (Feb.) 


Cognitive Research on the Teacher Listing Form for 
the Schools and Staffing Survey 


Dan Kasprzyk 


96-06 (Mar.) 


The Schools and Staffing Survey (SASS) for 1998-99: 
Design Recommendations to Inform Broad Education 
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Dan Kasprzyk 


96-07 (Mar.) 
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Teacher Effectiveness? 


Dan Kasprzyk 
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Jerry West 


96-09 (Apr.) 
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Dan Kasprzyk 


96-10 (Apr.) 
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Dan Kasprzyk 


96-1 1 (June) 


Towards an Organizational Database on America’s 
Schools: A Proposal for the Future of SASS, with 
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Dan Kasprzyk 


96-12 (June) 


Predictors of Retention, Transfer, and Attrition of 
Special and General Education Teachers: Data from 
the 1989 Teacher Followup Survey 


Dan Kasprzyk 


96-13 (June) 
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Steven Kaufman 
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The 1995 National Household Education Survey: 
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Steven Kaufman 
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Andrew G. 
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Surveys for 1993-94 


Steven Kaufman 




35 



Listing of NCES Working Papers to Date— Continued 



Number 



Title 



Contact 



96-28 (Nov.) 

96-29 (Nov.) 

96- 30 (Dec.) 

97- 01 (Feb.) 

97-02 (Feb.) 
97-03 (Feb.) 

97-04 (Feb.) 
97-05 (Feb.) 
97-06 (Feb.) 
97-07 (Mar.) 
97-08 (Mar.) 



Student Learning, Teaching Quality, and Professional 
Development: Theoretical Linkages, Current 
Measurement, and Recommendations for Future Data 
Collection 

Undercoverage Bias in Estimates of Characteristics of 
Adults and 0- to 2-Year-Olds in the 1995 National 
Household Education Survey (NHES:95) 

Comparison of Estimates from the 1995 National 
Household Education Survey (NHES:95) 

Selected Papers on Education Surveys: Papers 
Presented at the 1996 Meeting of the American 
Statistical Association 

Telephone Coverage Bias and Recorded Interviews in 
the 1993 National Household Education Survey 
(NHES:93) 

1991 and 1995 National Household Education Survey 
Questionnaires: NHES:91 Screener, NHES:91 Adult 
Education, NHES:95 Basic Screener, and NHES:95 
Adult Education 

Design, Data Collection, Monitoring, Interview 
Administration Time, and Data Editing in the 1993 
National Household Education Survey (NHES:93) 

Unit and Item Response, Weighting, and Imputation 
Procedures in the 1993 National Household Education 
Survey (NHES:93) 

Unit and Item Response, Weighting, and Imputation 
Procedures in the 1995 National Household Education 
Survey (NHES:95) 

The Determinants of Per-Pupil Expenditures in 
Private Elementary and Secondary Schools: An 
Exploratory Analysis 

Design, Data Collection, Interview Timing, and Data 
Editing in the 1995 National Household Education 
Survey 



Mary Rollefson 



Kathryn Chandler 

Kathryn Chandler 
Dan Kasprzyk 

Kathryn Chandler 

Kathryn Chandler 



Kathryn Chandler 



Kathryn Chandler 



Kathryn Chandler 



Stephen 

Broughman 



Kathryn Chandler 





36 



Listing of NCES Working Papers to Date— Continued 



Number 


Title 


Contact 


97-09 (Apr.) 


Status of Data on Crime and Violence in Schools: 
Final Report 


Lee Hoffman 


97-10 (Apr.) 


Report of Cognitive Research on the Public and 
Private School Teacher Questionnaires for the Schools 
and Staffing Survey 1993-94 School Year 


Dan Kasprzyk 


97-11 (Apr.) 


International Comparisons of Inservice Professional 
Development 


Dan Kasprzyk 


97-12 (Apr.) 


Measuring School Reform: Recommendations for 
Future SASS Data Collection 


Mary Rollefson . 


97-13 (Apr.) 


Improving Data Quality in NCES: Database-to-Report 
Process 


Susan Ahmed 


97-14 (Apr.) 


Optimal Choice of Periodicities for the Schools and 
Staffing Survey: Modeling and Analysis 


Steven Kaufman 


97-15 (May) 


Customer Service Survey: Common Core of Data 
Coordinators 


Lee Hoffman 


97-16 (May) 


International Education Expenditure Comparability 
Study: Final Report, Volume I 


Shelley Bums 


97-17 (May) 


International Education Expenditure Comparability 
Study: Final Report, Volume n. Quantitative Analysis 
of Expenditure Comparability 


Shelley Bums 


97-18 (June) 


Improving the Mail Return Rates of SASS Surveys: A 
Review of the Literature 


Steven Kaufman 


97-19 (June) 


National Household Education Survey of 1995: Adult 
Education Course Coding Manual 


Peter Stowe 


97-20 (June) 


National Household Education Survey of 1995: Adult 
Education Course Code Merge Files User’s Guide 


Peter Stowe 


97-21 (June) 


Statistics for Policymakers or Everything You Wanted 
to Know About Statistics But Thought You Could 
Never Understand 


Susan Ahmed 


97-22 (July) 


Collection of Private School Finance Data: 
Development of a Questionnaire 


Stephen 

Broughman 



er|c 



37 



Listing of NCES Working Papers to Date— Continued 



Number 


Title 


Contact 


97-23 (July) 


Further Cognitive Research on the Schools and 
Staffing Survey (SASS) Teacher Listing Form 


Dan Kasprzyk 


97-24 (Aug.) 


Formulating a Design for the ECLS: A Review of 
Longitudinal Studies 


Jerry West 


97-25 (Aug.) 


1996 National Household Education Survey 
(NHES:96) Questionnaires: Screener/Household and 
Library, Parent and Family Involvement in Education 
and Civic Involvement, Youth Civic Involvement, and 
Adult Civic Involvement 


Kathryn Chandler 


97-26 (Oct.) 


Strategies for Improving Accuracy of Postsecondary 
Faculty Lists 


Linda Zimbler 


97-27 (Oct.) 


Pilot Test of BPEDS Finance Survey 


Peter Stowe 


97-28 (Oct.) 


Comparison of Estimates in the 1996 National 
Household Education Survey 


Kathryn Chandler 


97-29 (Oct.) 


Can State Assessment Data be Used to Reduce State 
NAEP Sample Sizes? 


Steven Gorman 


97-30 (Oct.) 


ACT’S NAEP Redesign Project: Assessment Design is 
the Key to Useful and Stable Assessment Results 


Steven Gorman 


97-31 (Oct.) 


NAEP Reconfigured: An Integrated Redesign of the 
National Assessment of Educational Progress 


Steven Gorman 


97-32 (Oct.) 


Innovative Solutions to Intractable Large Scale 
Assessment (Problem 2: Background Questionnaires) 


Steven Gorman 


97-33 (Oct.) 


Adult Literacy: An International Perspective 


Marilyn Binkley 


97-34 (Oct.) 


Comparison of Estimates from the 1993 National 
Household Education Survey 


Kathryn Chandler 


97-35 (Oct.) 


Design, Data Collection, Interview Administration 
Time, and Data Editing in the 1996 National 
Household Education Survey 


Kathryn Chandler 


97-36 (Oct.) 


Measuring the Quality of Program Environments in 
Head Start and Other Early Childhood Programs: A 
Review and Recommendations for Future Research 


Jerry West 



ERIC 



38 



Listing of NCES Working Papers to Date— Continued 



Number 


Title 


Contact 


97-37 (Nov.) 


Optimal Rating Procedures and Methodology for 
NAEP Open-ended Items 


Steven Gorman 


97-38 (Nov.) 


Reinterview Results for the Parent and Youth 
Components of the 1996 National Household 
Education Survey 


Kathryn Chandler 


97-39 (Nov.) 


Undercoverage Bias in Estimates of Characteristics of 
Households and Adults in the 1996 National 
Household Education Survey 


Kathryn Chandler 


97-40 (Nov.) 


Unit and Item Response Rates, Weighting, and 
Imputation Procedures in the 1996 National 
Household Education Survey 


Kathryn Chandler 


97-41 (Dec.) 


Selected Papers on the Schools and Staffing Survey: 
Papers Presented at the 1997 Meeting of the American 
Statistical Association 


Steve Kaufman 


97-42 
(Jan. 1998) 


Improving the Measurement of Staffing Resources at 
the School Level: The Development of 
Recommendations for NCES for the Schools and 
Staffing Survey (SASS) 


Mary Rollefson 


97-43 (Dec.) 


Measuring Inflation in Public School Costs 


William J. Fowler, 
Jr. 


97-44 (Dec.) 


Development of a SASS 1993-94 School-Level 
Student Achievement Subfile: Using State 
Assessments and State NAEP, Feasibility Study 


Michael Ross 


98-01 (Jan.) 


Collection of Public School Expenditure Data: 
Development of a Questionnaire 


Stephen 

Broughman 


98-02 (Jan.) 


Response Variance in the 1993-94 Schools and 
Staffing Survey: A Reinterview Report 


Steven Kaufman 


98-03 (Feb.) 


Adult Education in the 1990s: A Report on the 1991 
National Household Education Survey 


Peter Stowe 


98-04 (Feb.) 


Geographic Variations in Public Schools’ Costs 


William J. Fowler, 



Jr. 



Listing of NCES Working Papers to Date— Continued 



Number 


Title 


Contact 


98-05 (Mar.) 


SASS Documentation: 1993-94 SASS Student 
Sampling Problems; Solutions for Determining the 
Numerators for the SASS Private School (3B) 
Second-Stage Factors 


Steven Kaufman 


98-06 (May) 


National Education Longitudinal Study of 1988 
(NELS:88) Base Year through Second Follow-Up: 
Final Methodology Report 


Ralph Lee 


98-07 (May) 


Decennial Census School District Project Planning 
Report 


Tai Phan 


98-08 (July) 


The Redesign of the Schools and Staffing Survey for 
1999-2000: A Position Paper 


Dan Kasprzyk 


98-09 (Aug.) 


High School Curriculum Structure: Effects on 
Coursetaking and Achievement in Mathematics for 
High School Graduates — An Examination of Data 
from the National Education Longitudinal Study of 
1988 


Jeffrey Owings 


98-10 (Aug.) 


Adult Education Participation Decisions and Barriers: 
Review of Conceptual Frameworks and Empirical 
Studies 


Peter Stowe 


98-11 (Aug.) 


Beginning Postsecondary Students Longitudinal Study 
First Follow-up (BPS:96-98) Field Test Report 


Aurora D’Amico 


98-12 (Oct.) 


A Bootstrap Variance Estimator for Systematic PPS 
Sampling 


Steven Kaufman 


98-13 (Oct.) 


Response Variance in the 1994-95 Teacher Follow-up 
Survey 


Steven Kaufman 


98-14 (Oct.) 


Variance Estimation of Imputed Survey Data 


Steven Kaufman 


98-15 (Oct.) 


Development of a Prototype System for Accessing 
Linked NCES Data 


Steven Kaufman 


98-16(Dec.) 


A Feasibility Study of Longitudinal Design for 
Schools and Staffing Survey 


Stephen 

Broughman 


98-17 (Dec.) 


Developing the National Assessment of Adult 
Literacy: Recommendations from Stakeholders 


Sheida White 



Listing of NCES Working Papers to Date— Continued 



Number 


Title 


Contact 


1999-01 

(Jan.) 


A Birth Cohort Study: Conceptual and Design 
Considerations and Rationale 


Jerry West 


1999-02 

(Feb.) 


Tracking Secondary Use of the Schools and Staffing 
Survey Data: Preliminary Results 


Dan Kasprzyk 


1999-03 

(Feb.) 


Evaluation of the 1996-97 Nonfiscal Common Core of 
Data Surveys Data Collection, Processing, and Editing 
Cycle 


Beth Young 


1999-04 

(Feb.) 


Measuring Teacher Qualifications 


Dan Kasprzyk 



41 

o 

ERIC 




U.S. Department of Education 

Office of Educational Research and Improvement (OERI) 
National Library of Education (NLE) 
Educational Resources Information Center (ERIC) 




NOTICE 

REPROmiCTTON BASIS 




This document is covered by a signed “Reproduction Release 
(Blanket) form (on file within the ERIC system), encompassing all 
or classes of documents from its source organization and, therefore, 
does not require a “Specific Document” Release form. 



This document is Federally-fiinded, or carries its own permission to 
reproduce, or is otherwise in the public domain and, therefore, may 
be reproduced by ERIC without a signed Reproduction Release form 
(either “Specific Document” or “Blanket”). 




EFF-089 (9/97) 




